2023 Conference article Open Access

See at: ceur-ws.org | ISTI Repository | ISTI Repository | CNR ExploRA

2023 Conference article Open Access

See at: ceur-ws.org | ISTI Repository | CNR ExploRA

2023 Conference article Open Access

AIMH Lab 2022 activities for Vision
Ciampi L., Amato G., Bolettieri P., Carrara F., Di Benedetto M., Falchi F., Gennaro C., Messina N., Vadicamo L., Vairo C.
The explosion of smartphones and cameras has led to a vast production of multimedia data. Consequently, Artificial Intelligence-based tools for automatically understanding and exploring these data have recently gained much attention. In this short paper, we report some activities of the Artificial Intelligence for Media and Humanities (AIMH) laboratory of the ISTI-CNR, tackling some challenges in the field of Computer Vision for the automatic understanding of visual data and for novel interactive tools aimed at multimedia data exploration. Specifically, we provide innovative solutions based on Deep Learning techniques carrying out typical vision tasks such as object detection and visual counting, with particular emphasis on scenarios characterized by scarcity of labeled data needed for the supervised training and on environments with limited power resources imposing miniaturization of the models. Furthermore, we describe VISIONE, our large-scale video search system designed to search extensive multimedia databases in an interactive and user-friendly manner.Source: Ital-IA 2023, pp. 538–543, Pisa, Italy, 29-31/05/2023
Project(s): AI4Media

See at: ceur-ws.org | ISTI Repository | CNR ExploRA

2023 Report Open Access

See at: ISTI Repository | CNR ExploRA

2022 Conference article Open Access

See at: ISTI Repository | www.ital-ia2022.it | CNR ExploRA

2022 Conference article Open Access

See at: ISTI Repository | www.ital-ia2022.it | CNR ExploRA

2022 Conference article Open Access

See at: ISTI Repository | www.ital-ia2022.it | CNR ExploRA

2022 Journal article Open Access

An embedded toolset for human activity monitoring in critical environments
Di Benedetto M., Carrara F., Ciampi L., Falchi F., Gennaro C., Amato G.
In many working and recreational activities, there are scenarios where both individual and collective safety have to be constantly checked and properly signaled, as occurring in dangerous workplaces or during pandemic events like the recent COVID-19 disease. From wearing personal protective equipment to filling physical spaces with an adequate number of people, it is clear that a possibly automatic solution would help to check compliance with the established rules. Based on an off-the-shelf compact and low-cost hardware, we present a deployed real use-case embedded system capable of perceiving people's behavior and aggregations and supervising the appliance of a set of rules relying on a configurable plug-in framework. Working on indoor and outdoor environments, we show that our implementation of counting people aggregations, measuring their reciprocal physical distances, and checking the proper usage of protective equipment is an effective yet open framework for monitoring human activities in critical conditions.Source: Expert systems with applications 199 (2022). doi:10.1016/j.eswa.2022.117125
DOI: 10.1016/j.eswa.2022.117125
Project(s): AI4EU , AI4Media
Metrics:

See at: ISTI Repository | CNR ExploRA

2022 Contribution to conference Open Access

AI and computer vision for smart cities
Amato G., Carrara F., Ciampi L., Di Benedetto M., Gennaro C., Falchi F., Messina N., Vairo C.
Artificial Intelligence (AI) is increasingly employed to develop public services that make life easier for citizens. In this abstract, we present some research topics and applications carried out by the Artificial Intelligence for Media and Humanities (AIMH) laboratory of the ISTI-CNR of Pisa about the study and development of AI-based services for Smart Cities dedicated to the interaction with the physical world through the analysis of images gathered from city cameras. Like no other sensing mechanism, networks of city cameras can 'observe' the world and simultaneously provide visual data to AI systems to extract relevant information and make/suggest decisions helping to solve many real-world problems. Specifically, we discuss some solutions in the context of smart mobility, parking monitoring, infrastructure management, and surveillance systems.Source: I-CiTies 2022 - 8th Italian Conference on ICT for Smart Cities And Communities, Ascoli Piceno, Italy, 14-16/09/2022
Project(s): AI4Media

See at: icities2022.unicam.it | ISTI Repository | ISTI Repository | CNR ExploRA

2022 Contribution to conference Open Access

CrowdVisor: an embedded toolset for human activity monitoring in critical environments
Di Benedetto M., Carrara F., Ciampi L., Falchi F., Gennaro C., Amato G.
As evidenced during the recent COVID-19 pandemic, there are scenarios in which ensuring compliance to a set of guidelines (such as wearing medical masks and keeping a certain physical distance among people) becomes crucial to secure a safe living environment. However, human supervision could not always guarantee this task, especially in crowded scenes. This abstract presents CrowdVisor, an embedded modular Computer Vision-based and AI-assisted system that can carry out several tasks to help monitor individual and collective human safety rules. We strive for a real-time but low-cost system, thus complying with the compute- and storage-limited resources availability typical of off-the-shelves embedded devices, where images are captured and processed directly onboard. Our solution consists of multiple modules relying on well-researched neural network components, each responsible for specific functionalities that the user can easily enable and configure. In particular, by exploiting one of these modules or combining some of them, our framework makes available many capabilities. They range from the ability to estimate the so-called social distance to the estimation of the number of people present in the monitored scene, as well as the possibility to localize and classify Personal Protective Equipment (PPE) worn by people (such as helmets and face masks). To validate our solution, we test all the functionalities that our framework makes available over two novel datasets that we collected and annotated on purpose. Experiments show that our system provides a valuable asset to monitor compliance with safety rules automatically.Source: I-CiTies 2022 - 8th Italian Conference on ICT for Smart Cities And Communities, Ascoli Piceno, Italy, 14-16/09/2022
Project(s): AI4EU , AI4Media

See at: icities2022.unicam.it | ISTI Repository | ISTI Repository | CNR ExploRA

2022 Journal article Open Access

Deep networks for behavioral variant frontotemporal dementia identification from multiple acquisition sources
Di Benedetto M., Carrara F., Tafuri B., Nigro S., De Blasi R., Falchi F., Gennaro C., Gigli G., Logroscino G., Amato G.
Behavioral variant frontotemporal dementia (bvFTD) is a neurodegenerative syndrome whose clinical diagnosis remains a challenging task especially in the early stage of the disease. Currently, the presence of frontal and anterior temporal lobe atrophies on magnetic resonance imaging (MRI) is part of the diagnostic criteria for bvFTD. However, MRI data processing is usually dependent on the acquisition device and mostly require human-assisted crafting of feature extraction. Following the impressive improvements of deep architectures, in this study we report on bvFTD identification using various classes of artificial neural networks, and present the results we achieved on classification accuracy and obliviousness on acquisition devices using extensive hyperparameter search. In particular, we will demonstrate the stability and generalization of different deep networks based on the attention mechanism, where data intra-mixing confers models the ability to identify the disorder even on MRI data in inter-device settings, i.e., on data produced by different acquisition devices and without model fine tuning, as shown from the very encouraging performance evaluations that dramatically reach and overcome the 90% value on the AuROC and balanced accuracy metrics.Source: Computers in biology and medicine 148 (2022). doi:10.1016/j.compbiomed.2022.105937
DOI: 10.1016/j.compbiomed.2022.105937
Project(s): AI4Media
Metrics:

See at: ISTI Repository | www.sciencedirect.com | CNR ExploRA

2022 Report Open Access

See at: ISTI Repository | CNR ExploRA

2021 Report Open Access

See at: ISTI Repository | CNR ExploRA

2020 Journal article Open Access

Learning accurate personal protective equipment detection from virtual worlds
Di Benedetto M., Carrara F., Meloni E., Amato G., Falchi F., Gennaro C.
Deep learning has achieved impressive results in many machine learning tasks such as image recognition and computer vision. Its applicability to supervised problems is however constrained by the availability of high-quality training data consisting of large numbers of humans annotated examples (e.g. millions). To overcome this problem, recently, the AI world is increasingly exploiting artificially generated images or video sequences using realistic photo rendering engines such as those used in entertainment applications. In this way, large sets of training images can be easily created to train deep learning algorithms. In this paper, we generated photo-realistic synthetic image sets to train deep learning models to recognize the correct use of personal safety equipment (e.g., worker safety helmets, high visibility vests, ear protection devices) during at-risk work activities. Then, we performed the adaptation of the domain to real-world images using a very small set of real-world images. We demonstrated that training with the synthetic training set generated and the use of the domain adaptation phase is an effective solution for applications where no training set is available.Source: Multimedia tools and applications (2020). doi:10.1007/s11042-020-09597-9
DOI: 10.1007/s11042-020-09597-9
Project(s): AI4EU
Metrics:

See at: ISTI Repository | Multimedia Tools and Applications | link.springer.com | CNR ExploRA

2020 Report Open Access

See at: ISTI Repository | CNR ExploRA

2019 Conference article Open Access

See at: ISTI Repository | www.ital-ia.it | CNR ExploRA

2019 Conference article Open Access

Learning Safety Equipment Detection using Virtual Worlds
Di Benedetto M., Meloni E., Amato G., Falchi F., Gennaro C.
Nowadays, the possibilities offered by state-of-The-Art deep neural networks allow the creation of systems capable of recognizing and indexing visual content with very high accuracy. Performance of these systems relies on the availability of high quality training sets, containing a large number of examples (e.g. million), in addition to the the machine learning tools themselves. For several applications, very good training sets can be obtained, for example, crawling (noisily) annotated images from the internet, or by analyzing user interaction (e.g.: on social networks). However, there are several applications for which high quality training sets are not easy to be obtained/created. Consider, as an example, a security scenario where one wants to automatically detect rarely occurring threatening events. In this respect, recently, researchers investigated the possibility of using a visual virtual environment, capable of artificially generating controllable and photo-realistic contents, to create training sets for applications with little available training images. We explored this idea to generate synthetic photo-realistic training sets to train classifiers to recognize the proper use of individual safety equipment (e.g.: worker protection helmets, high-visibility vests, ear protection devices) during risky human activities. Then, we performed domain adaptation to real images by using a very small image data set of real-world photographs. We show that training with the generated synthetic training set and using the domain adaptation step is an effective solution to address applications for which no training sets exist.Source: 2019 International Conference on Content-Based Multimedia Indexing (CBMI), Dublin, Ireland, 4/9/2019, 6/9/2019
DOI: 10.1109/cbmi.2019.8877466
Project(s): AI4EU
Metrics:

See at: ISTI Repository | doi.org | ieeexplore.ieee.org | CNR ExploRA

2019 Report Open Access

See at: ISTI Repository | CNR ExploRA

2018 Conference article Open Access

See at: ISTI Repository | doi.org | link.springer.com | CNR ExploRA

Web and mobile visualization for cultural heritage
Di Benedetto M., Ponchio F., Malomo L., Callieri M., Dellepiane M., Cignoni P., Scopigno R.
Thanks to the impressive research results produced in the last decade, digital technologies are now mature for producing high-quality digital replicas of Cultural Heritage (CH) artifacts. At the same time, CH practitioners and scholars have also access to a number of technologies that allow distributing and presenting those models to everybody and everywhere by means of a number of communication platforms. The goal of this chapter is to present some recent technologies for supporting the visualization of complex models, by focusing on the requirements of interactive manipulation and visualization of 3D models on the web and on mobile platforms. The section will present some recent experiences where high-quality 3D models have been used in CH research, restoration and conservation. Some open issues in this domain will also be presented and discussed.Source: 3D Research Challenges in Cultural Heritage. A Roadmap in Digital Heritage Preservation, edited by Marinos Ioannides, Ewald Quak, pp. 18–35. Berlin: Springer, 2014
DOI: 10.1007/978-3-662-44630-0_2
Project(s): ARIADNE
Metrics:

See at: doi.org | link.springer.com | CNR ExploRA